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ALGORITHM TO PRINT DV DATA TO A DV 
DECK WITH FRAME ACCURACY 

CROSS-REFERENCE TO RELATED APPLICATION 

[01] The present application claims priority to U.S. provisional patent application, Serial 
No. 60/224,910, filed August 11, 2000, entitled "Frame Accurate Rendering Of 
Digital Video Data", invented by Yee J. Wu, and incorporated by reference herein. 

BACKGROUND OF THE INVENTION 

Field of the Invention 

[02] The invention relates to a technique for recording data on a digital video device. 
More particularly, the present invention relates to a method and system for recording 
digital video data on a digital video device under the control of a digital video 
application running on a host device. 



Background of the Related Art 

[03] A Digital Video (DV) device, such as a camcorder or tape recorder and player, 
permits a user to record audio/visual data (DV data) onto a recording medium and 
output the DV data to, for example, a personal computer (PC) running an application 
for editing DV data. A user can process the DV data using the application to edit 
portions of the DV data, delete unwanted portions of the DV data and/or to add 
effects such as fading, visual effects, sound effects, etc. The edited DV data can then 
be sent back to the DV device for storage on the recording medium of the DV device. 
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[04] DV device limitations have resulted in possibly losing the leading portion of a stream 
of DV data when DV data is printed to a DV device from the PC. Additionally, DV 
device limitations have also resulted in frame-inaccurate assembly editing, that is, the 
inability to accurately start a recording of streaming DV data at a selected track of a 
DV medium. 

[05] To address the data loss problem, many conventional DV data-editing applications 
set a DV device to a RECORD mode before DV data is sent to the DV device to 
avoid losing data. In particular, some currently-available DV devices reject an audio 
video control (AV/C) RECORD control command when the DV device does not 
sense data on the bus. While such an operating condition provides the advantage 
automatically stopping the DV device when recording has finished, i.e., the DV data 
has ended, data must be on the bus when an AV/C RECORD control command is 
sent to the DV device at the beginning of a recording operation. 

[06] On the other hand, depending on the DV device, the DV device may permit a 
RECORD PAUSE state before DV data is streamed to the DV device. Such an 
approach, though, does not entirely avoid data loss for DV devices that permit a 
RECORD PAUSE state without DV data because some DV devices reject a START 
RECORDING setting unless there are streaming data present. For example, the 
RECORD mode for at least two popular DV devices can be set when there is no data 
on the bus, but both DV devices change their internal plug control registers from 
"listening" to "broadcast channel 63" so that when an application attempts to 
program the input Plug Control Register (iPCR), the D V device appears to be busy. 
Consequently, to overcome this problem, data should be placed on the bus before 
either of the DV devices are set to the RECORD mode. 
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[07] Consequently, a DV application cannot simply issue a device control to start 
recording and then send streaming data without an appropriate delay; otherwise, the 
beginning portion of the streaming data will be lost. 

[08] Yet another problem associated with printing data to a DV device includes that the 
DV device recording mechanism that is used for locking, or synchronizing, to the 
streaming DV data sent over an IEEE-1394 serial bus does not respond 
instantaneously. Still another problem is that the recording mechanism of a DV 
device that has locked to the streaming data does not provide feedback notification to 
the host (PC) that the D V device is ready to record. A further problem is that when a 
DV device transitions between transport states, such as from STOP to RECORD, 
transitioning is not instantaneous. 

[09] What is needed is a technique for streaming DV data to a DV device for storing the 
DV data on a recording media of the DV device without losing the leading section of 
the streaming data. What is also needed is a technique for streaming DV data to a 
DV device for storing the DV data on a recording medium of the DV device in a 
frame-accurate manner. 

BRIEF SUMMARY OF THE INVENTION 

[10] The present invention provides a technique for streaming DV data to a DV device for 
storing the D V data on a recording media of the D V device without losing the leading 
section of the streaming data. The present invention also provides a technique for 
streaming DV data to a DV device for storing the DV data on a recording medium of 
the DV device in a frame-accurate manner. 
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[11] The advantages of the present invention are provided by a method and a system for 
streaming DV data to a DV device over, for example, an IEEE-1394 bus, without 
losing the leading section of the streaming data, and in a frame-accurate manner. 
According to the invention, a command is sent to the DV device for performing an 
absolute track number search for a selected track number where recording will begin. 
Then, a predetermined number of frames of DV data are pre-rolled. The 
predetermined number of frames that are pre-rolled depends on the particular DV 
device. The first frame of DV data is then repeatedly sent to the DV device. Next, a 
command is sent to the DV device to place the DV device in a RECORD PAUSE 
state, and a wait operation of a predetermined period of time is performed so that the 
D V device becomes ready to record DV data. A command is sent to the DV device 
to place the D V device in a RECORD transport state, and DV data is sent to the DV 
device in a real-time manner for recording. Additionally, a user is queried for 
information identifying the particular DV device, for example, by displaying a list 
identifying a plurality of DV devices. Information is then received from the user 
identifying the particular DV device so that the appropriate number of frames can be 
pre-rolled for the DV device and the appropriate amount of time will elapse for the 
DV device to become synchronized with the DV data. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[12] The present invention is illustrated by way of example and not limitation in the 
accompanying figures in which like reference numerals indicate similar elements and 
in which: 

[13] Figure 1 shows an exemplary computing environment that is suitable for the present 
invention; 
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[14] Figure 2 shows an exemplary arrangement of a DV device and a host device 
according to the present invention that provides a frame-accurate streaming DV data 
that is printed back to the DV device without losing the leading section of the 
streaming data; 

[15] Figure 3 is a temporal relationship diagram illustrating delays t,-t 5 according to the 
present invention; 

[16] Figure 4 is a detailed flow diagram for a stream DV data operation to a current 
location of a DV recording medium without losing the leading section of the 
streaming data according to the present invention; and 

[17] Figure 5 shows a flow diagram for providing frame accurate linear assembly editing 
according to the present invention. 

DETAILED DESCRIPTION OF THE INVENTION 

[18] The present invention may be more readily described with reference to Figures 1 
through 5. Figure 1 illustrates a schematic diagram of a conventional general- 
purpose digital computing environment that can be used to implement various 
aspects of the present invention. In Figure 1, a computer 100 includes a processing 
unit 1 10, a system memory 120, and a system bus 130 that couples various system 
components including the system memory to processing unit 1 1 0. System bus 1 30 
may be any of several types of bus structures including a memory bus or memory 
controller, a peripheral bus, and a local bus using any of a variety of bus 
architectures. System memory 120 includes read only memory (ROM) 140 and 
random access memory (RAM) 150. 



5 



MS 133043.2 
B&W 3797.00161 

[19] A basic input/output system 1 60 (BIOS), containing the basic routines that help to 
transfer information between elements within computer 1 00, such as during start-up, 
is stored in ROM 140. The computer 100 also includes a hard disk drive 170 for 
reading from and writing to a hard disk (not shown), a magnetic disk drive 1 80 for 
reading from or writing to a removable magnetic disk 1 90, and an optical disk drive 
191 for reading from or writing to a removable optical disk 192 such as a CD ROM 
or other optical media. Hard disk drive 170, magnetic disk drive 180, and optical 
disk drive 1 9 1 are connected to the system bus 1 3 0 by a hard disk drive interface 1 92, 
a magnetic disk drive interface 193, and an optical disk drive interface 194, 
respectively. The drives and their associated computer-readable media provide 
nonvolatile storage of computer readable instructions, data structures, program 
modules and other data for personal computer 100. It will be appreciated by those 
skilled in the art that other types of computer readable media that can store data that 
is accessible by a computer, such as magnetic cassettes, flash memory cards, digital 
video disks, Bernoulli cartridges, random access memories (RAMs), read only 
memories (ROMs), and the like, may also be used in the example operating 
environment. 

[20] A number of program modules can be stored on hard disk drive 1 70, magnetic disk 
190, optical disk 192, ROM 140 or RAM 150, including an operating system 195, 
one or more application programs 196, other program modules 197, and program 
data 198. A user can enter commands and information into computer 100 through 
input devices such as a keyboard 101 and pointing device 102. Other input devices 
(not shown) may include a microphone, joystick, game pad, satellite dish, scanner or 
the like. These and other input devices are often connected to processing unit 1 10 
through a serial port interface 106 that is coupled to the system bus, but may be 
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connected by other interfaces, such as a parallel port, game port, a universal serial bus 
(USB) or an IEEE-1394 serial bus. Further still, these devices may be coupled 
directly to system bus 1 30 via an appropriate interface (not shown). A monitor 1 07 
or other type of display device is also connected to system bus 130 via an interface, 
such as a video adapter 1 08. hi addition to the monitor, personal computers typically 
include other peripheral output devices (not shown), such as speakers and printers. 

[21] Computer 100 can operate in a networked environment using logical connections to 
one or more remote computers, such as a remote computer 109. Remote computer 
1 09 can be a server, a router, a network PC, a peer device or other common network 
node, and typically includes many or all of the elements described above relative to 
computer 100, although only a memory storage device 1 1 1 has been illustrated in 
Figure 1 . The logical connections depicted in Figure 1 include a local area network 
(LAN) 112 and a wide area network (WAN) 113. Such networking environments are 
commonplace in offices, enterprise-wide computer networks, intranets and the 
Internet. 

[22] When used in a LAN networking environment, computer 1 00 is connected to local 
area network 1 12 through a network interface or adapter 1 14. When used in a WAN 
networking environment, personal computer 100 typically includes a modem 1 15 or 
other device for establishing a communications over wide area network 113, such as 
the Internet. Modem 1 15, which maybe internal or external, is connected to system 
bus 130 via the serial port interface 106. In a networked environment, program 
modules depicted relative to personal computer 100, or portions thereof, may be 
stored in a remote memory storage device. 
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[23] It will be appreciated that the network connections shown are exemplary and other 
techniques for establishing a communications link between the computers can be 
used. The existence of any of various well-known protocols such as TCP/IP, 
Ethernet, FTP, HTTP and the like is presumed, and the system can be operated in a 
client-server configuration to permit a user to retrieve web pages from a web-based 
server. Any of various conventional web browsers can be used to display and 
manipulate data on web pages. 

[24] A primary aspect of the invention provides a technique for streaming DV data to a 
DV device for storing the DV data on a recording media of the DV device without 
losing the leading section of the streaming data. Another aspect of the present 
invention provides a technique for streaming D V data to a D V device for storing the 
DV data on a recording medium of the DV device in a frame-accurate manner. 

[25] Figure 2 shows an exemplary arrangement of a DV device 201 , such as a camcorder 
or tape recorder/player, and a host device 202, such as a personal computer (PC), in 
which DV data can be streamed from host device 202 to DV device 201 without 
losing the leading section of the streaming data and in a frame-accurate manner 
according to the present invention. Preferably, DV device 201 is coupled to host 
device 202 through an IEEE-1 394 bus 203. Accordingly, DV device 201 includes an 
IEEE-1394 interface that is not shown. Host device 202 includes a DV application 
204, such as "DIRECTSHOW" Filter Graph Editor available from Microsoft, a 
device driver 205, such as msdv.sys, an IEEE 1394 host controller 206, and a mass 
storage device 207. Device driver 205 controls the state of DV device 201 directly, 
but does so by serving requests from application 204. Mass storage device 207 can 
be any suitable mass storage device, such as a magnetic disk drive, an optical disk 
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drive, or an electronic memory that can store DV data and access the DV data at a 
rate that is sufficient for streaming D V data to a DV device. It should be understood 
that host device 202 includes other components, such as a processor, interface 
devices, etc., such as described in connection with Figure 1. 

[26] Preferably, DV device 201 includes a DV medium 208, such as a magnetic tape, that 
is formatted with time codes and track numbers in a well-known manner. 
Additionally, DV device 201 preferably provides support for Audio/Video Control 
(AV/C) control commands and specifically for an Absolute Track Number (ATN) 
control command (track searching). According to the invention, two operating 
parameters of the DV device must be known a priori before DV data is streamed 
from host device 202 to DV device 201. In particular, the number of frames that 
must be pre-rolled to compensate for the relative positions of the tape and recording 
head caused by a transport state change must be known (referred to herein as "a3"), 
and the time, in units of the number of frames (referred to herein as "a4"), that must 
elapse after setting DV device 201 to the RECORD transport state before DV device 
201 to ready to record must be known. When the broadcast standard is the NTSC 
standard, a frame has a duration of about 33 milliseconds. When the broadcast 
standard is the PAL standard, a frame has a duration of about 40 milliseconds. 
Accordingly, these two operational parameters vary from DV device to DV device. 

[27] The following is a list for pre-roll (a3) and RECORD ready wait (a4) for selected 
exemplary DV devices. 

Sony 

PC-1 : (a3) 4 frames, (a4) 6 frames 
VX-100: (a3) 4 frames, (a4) 5 frames 
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Cation 

Elura: (a3) -4 frames, (a4) 28 frames 
Panasonic 

PV DV-710: (a3) 3 frames, (a4) 11 frames 

[28] The streaming state of a DV device, such as the STOP, PAUSE and RUN states, and 
the transport state of a DV device (in the VTR mode), such as STOP, RECORD 
PAUSE and RECORD states, are independent of each other and are indirectly 
controlled by a DV application running on, for example, a PC. When DV data is 
printed, i.e., streamed, to a DV device, five delays (t r t 5 ) must be properly applied so 
that the streaming state can be synchronized to the transport state of a DV device. 

[29] Delays t r t 5 are defined as follows. Delay t, is the time delay, measured in frames, 
that is required for synchronizing the streaming data on the bus to the recording 
mechanism of a DV device. Delay t 2 is the delay in frames that is required for 
transitioning a DV device from a STOP (or other transport) state to a RECORD 
PAUSE transport state. Delay t 3 is zero when it can be determined, for example, by 
polling the DV device, that the DV device has reached the RECORD PAUSE state. 
Delay t 4 is the delay required for transitioning from a DV device from a RECORD 
PAUSE transport state to a RECORD transport state. Delay t4 is identical to 
operating parameter (a4) described above. Delay t 5 is the delay required for 
preempting repeated frames that are still queued in bus driver (at most three frames). 

[30] Figure 3 is a temporal relationship diagram illustrating delays t r t 5 according to the 
present invention. In Figure 3, 301 represents the DV recording medium; 302 
represents the streaming state of the DV application; 303 represents the presence of 
DV data; 304 represent the transport state of the DV device. 
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[31] All five delays vary between different DV devices, whether the DV device is 
available from a different manufacturer or from the same manufacturer of different 
models. Preferably, an application profiles each available DV device and queries a 
user to select a D V device from a list. Alternatively, default delays can be set within 
an application that can be adjusted by a user for achieving optimum results. 

[32] Figure 4 is a more detailed flow diagram 400 for a stream DV data operation to a 
current location of a DV recording medium without losing the leading section of the 
streaming data according to the present invention. At step 401, DV data is built 
using the tape filter graph application, such as the "DIRECTSHOW" Filter Graph 
Editor application available from Microsoft. During step 401 , the DV device in the 
VTR mode. At step 402, the tape filter graph application is set to the pause 
streaming state. While in the pause streaming state, the first frame of DV data is 
repeatedly sent to the DV device so that the recording mechanism of the DV deck 
lock (i.e., synchronizes) without advancing frames. At step 403, a command is sent 
to the DV device from the host device running the application that sets the DV device 
to the RECORD PAUSE transport state. Depending on the particular DV device, a 
wait operation of up to three (3) seconds is performed so that the DV device has 
received the first frame of DV data and the recording mechanism of the DV device 
has become synchronized with the D V data, thereby the DV device is ready to record. 
(This is accomplished when the first frame appears on the LCD (liquid crystal 
display) of the DV device.) 

[33] At step 404, a delay operation that is the sum of delay t> and delay t, frames based on 
the DV device that is being used. At step 405, it is determined whether delay t 4 is 
greater that or equal to delayt 5 . If so, flow continues to step 406 where a command is 
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sent to the DV device setting the transport state to RECORD. Flow continues to step 
407 where a delay of (t 4 - 1 5 ) frames is performed. At step 408, the state of the tape 
filter graph application is changed from the pause streaming state to run state. At 
step 409, DV data is streamed to the DV device and recorded. At step 410, it is 
determined whether transmission of DV data to the DV device is complete. If so, 
flow continues to step 41 1 where a command is sent to the DV device for setting the 
DV device from the streaming state to STOP or to the RECORD PAUSE state. If at 
step 410, transmission of the DV data is not complete, flow returns to step 409. 

[34] If, at step 405, delay t 4 is not greater than or equal to delay t 5 , then flow continues to 
step 412 where the state of the tape filter graph application is changed from the pause 
streaming state to run state. Flow continues to step 413 where a delay of (t; - 1 4 ) 
frames is performed. Flow continues to step 4 1 4 where a command is sent to the D V 
device setting the transport state to RECORD. Subsequently, flow continues to step 
509. 

[35] To record DV data starting at a specific track number, the DV device is required to 
support an AV/C ATN control command for searching to a specific track number and 
an AV/C control command to set the D V device from the transport state to the PLAY 
PAUSE state. Additionally, the recording medium of the DV device must be 
formatted in a well-known manner with contiguous track numbers. It should be 
understood that while an application program will typically allow a user to select a 
particular time position, or time code, on a DV tape, a corresponding selected time 
position can be converted to an ATN in a well-known manner. 



[36] 



The following parameters are additional DV device parameters that must be 
controllable for the present invention to provide frame-accurate linear assembly 
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editing. Parameter (Fl) is the number of frames that are required to be pre-rolled 
when a DV device is transitioning from a PLAY PAUSE state to a RECORD PAUSE 
state. Parameter (Fl) can be a positive or negative number. Parameter (Fl) is 
identical to operating parameter (a3) described above. Parameter (F2) is the number 
of frames that are required to be pre-rolled when a DV device is transitioning from a 
RECORD PAUSE state to a RECORD state. Parameter (F2) is usually zero. 

[37] To illustrate the frame-accurate linear assembly editing aspect of the present 
invention, consider an absolute target track Tl on a DV medium, such as a DV tape, 
that is selected for the start of a recording. Figure 5 shows a flow diagram 500 for 
providing frame accurate linear assembly editing according to the present invention. 
At step 501 , DV data is built using a tape filter graph application with the DV device 
in the VTR mode. At step 502, a command is sent from the host device running the 
filter graph application to the DV device for performing an ATN search to track 
number (Tl - Fl) and an appropriate number of frames for the DV device are pre- 
rolled. Of course, steps 501 and 502 can be combined into a single operation. 

[38] At step 503, the tape filter graph application is set to the pause streaming state. 
While the filter graph application is in the pause streaming state, the first frame of 
DV data is repeatedly sent to the DV device so that the recording mechanism of the 
DV deck locks to the DV data without advancing frames. At step 504, a command is 
sent from the host device to the DV device setting the DV device to the RECORD 
PAUSE transport state. (Again, the DV device may change its current tape position 
during transport state change and is compensated for by pre-rolling frames, as 
previously described.) 
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[39] At step 505, a delay operation is performed that is the sum of delay tj and delay t 3 
frames for the particular D V device being used. At step 506, it is determined whether 
delay t 4 is greater that or equal to delay tj. If so, flow continues to step 507 where a 
command is sent from the host device to the DV device setting the transport state to 
RECORD. Flow continues to step 508 where a delay operation of (t 4 - 1 5 ) frames is 
performed. At step 509, the state of the tape filter graph application is changed from 
the streaming state to run state. At step 510, DV data is steamed to the DV device 
and recorded. At step 5 1 1 , it is determined whether transmission of DV data to the 
DV device is complete. If so, flow continues to step 512 where acommand is sent to 
the DV device for setting the DV device from the streaming state to STOP or to the 
RECORD PAUSE state. If, at step 511, transmission of the D V data is not complete, 
flow returns to step 510. 

[40] If, at step 506, delay t 4 is not greater than or equal to delayt 5 , then flow continues to 
step 513 where the state of the tape filter graph application is changed from the 
streaming state to run state. Flow continues to step 514 where a delay operation of 
(t 5 - 1 4 ) frames is performed. Flow continues to step 5 1 5 where a command is sent to 
the DV device setting the transport state to RECORD. Subsequently, flow continues 
to step 510. 

[41] The techniques of the present invention have been used with the "DIRECTSHOW" 
Filter Graph Editor application available from Microsoft for several currently- 
available DV devices. That is, the operation of the "DIRECTSHOW" Filter Graph 
Editor application available from Microsoft was modified to provide the techniques 
of the present invention, i.e., the pre-roll (a3) operations and the RECORD read wait 
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(a4) operations. As a result, D V data was streamed to a DV device without losing the 
leading section of the streaming data. 

[42] While the invention has been described with respect to specific examples including 
presently preferred modes of carrying out the invention, those skilled in the art will 
appreciate that there are numerous variations and permutations of the above 
described systems and techniques that fall within the spirit and scope of the invention 
as set forth in the appended claims. 
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